SherbyNet - /page/wikibook/entry.mu

Micron Document

<!DOCTYPE html>

<title>Compound-term processing</title>

</head>

<span id="openzim-page-title" class="mw-page-title-main"><span class="mw-page-title-main">Compound-term processing</span></span>

</h1>

</header>

<div id="mw-content-text" class="mw-body-content mw-content-ltr" lang="en" dir="ltr"><div class="mw-content-ltr mw-parser-output" lang="en" dir="ltr"><p><b>Compound-term processing,</b> in <a href="Information_retrieval" title="Information retrieval">information-retrieval</a>, is search result matching on the basis of <a href="Compound_term" class="mw-redirect" title="Compound term">compound terms</a>. Compound terms are built by combining two or more simple terms; for example, "triple" is a single word term, but "triple heart bypass" is a compound term.

</p><p>Compound-term processing is a new approach to an old problem: how can one improve the relevance of search results while maintaining ease of use? Using this technique, a search for <i>survival rates following a triple heart bypass in elderly people</i> will locate documents about this topic even if this precise phrase is not contained in any document. This can be performed by a <a href="Concept_search" title="Concept search">concept search</a>, which itself uses compound-term processing. This will extract the key concepts automatically (in this case "survival rates", "triple heart bypass" and "elderly people") and use these concepts to select the most relevant documents.

</p>

<div class="mw-heading mw-heading2"><h2 id="Techniques">Techniques</h2></div>

<p>In August 2003, <a href="Concept_Searching_Limited" title="Concept Searching Limited">Concept Searching Limited</a> introduced the idea of using statistical compound-term processing.<sup id="cite_ref-1" class="reference"><a href="#cite_note-1"><span class="cite-bracket">[</span>1<span class="cite-bracket">]</span></a></sup>

</p><p>CLAMOUR is a European collaborative project which aims to find a better way to classify when collecting and disseminating industrial information and statistics. CLAMOUR appears to use a linguistic approach, rather than one based on <a href="Statistical_model" title="Statistical model">statistical modelling</a>.<sup id="cite_ref-2" class="reference"><a href="#cite_note-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>

</p>

<div class="mw-heading mw-heading2"><h2 id="History">History</h2></div>

<p>Techniques for probabilistic weighting of single word terms date back to at least 1976 in the landmark publication by <a href="Stephen_Robertson_(computer_scientist)" title="Stephen Robertson (computer scientist)">Stephen E. Robertson</a> and <a href="Karen_Sp%C3%A4rck_Jones" title="Karen Spärck Jones">Karen Spärck Jones</a>.<sup id="cite_ref-3" class="reference"><a href="#cite_note-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup> Robertson stated that the assumption of word independence is not justified and exists as a matter of mathematical convenience. His objection to the term independence is not a new idea, dating back to at least 1964 when H. H. Williams stated that "[t]he assumption of independence of words in a document is usually made as a matter of mathematical convenience".<sup id="cite_ref-4" class="reference"><a href="#cite_note-4"><span class="cite-bracket">[</span>4<span class="cite-bracket">]</span></a></sup>

</p><p>In 2004, Anna Lynn Patterson filed patents on "phrase-based searching in an information retrieval system"<sup id="cite_ref-5" class="reference"><a href="#cite_note-5"><span class="cite-bracket">[</span>5<span class="cite-bracket">]</span></a></sup> to which <a href="Google" title="Google">Google</a> subsequently acquired the rights.<sup id="cite_ref-6" class="reference"><a href="#cite_note-6"><span class="cite-bracket">[</span>6<span class="cite-bracket">]</span></a></sup>

</p>

<div class="mw-heading mw-heading2"><h2 id="Adaptability">Adaptability</h2></div>

<p>Statistical compound-term processing is more adaptable than the process described by Patterson. Her process is targeted at searching the <a href="World_Wide_Web" title="World Wide Web">World Wide Web</a> where an extensive statistical knowledge of common searches can be used to identify candidate phrases. Statistical compound term processing is more suited to <a href="Enterprise_search" title="Enterprise search">enterprise search</a> applications where such <a href="A_priori_and_a_posteriori" title="A priori and a posteriori">a priori</a> knowledge is not available.

</p><p>Statistical compound-term processing is also more adaptable than the linguistic approach taken by the CLAMOUR project, which must consider the syntactic properties of the terms (i.e. part of speech, gender, number, etc.) and their combinations. CLAMOUR is highly language-dependent, whereas the statistical approach is language-independent.

</p>

<div class="mw-heading mw-heading2"><h2 id="Applications">Applications</h2></div>

<p>Compound-term processing allows information-retrieval applications, such as <a href="Search_engines" class="mw-redirect" title="Search engines">search engines</a>, to perform their matching on the basis of multi-word concepts, rather than on single words in isolation which can be highly ambiguous.

</p><p>Early search engines looked for documents containing the words entered by the user into the search box . These are known as <a href="Keyword_search" class="mw-redirect" title="Keyword search">keyword search</a> engines. <a href="Boolean_search" class="mw-redirect" title="Boolean search">Boolean search</a> engines add a degree of sophistication by allowing the user to specify additional requirements. For example, "Tiger NEAR Woods AND (golf OR golfing) NOT Volkswagen" uses the operators "NEAR", "AND", "OR" and "NOT" to specify that these words must follow certain requirements. A <a href="Phrase_search" title="Phrase search">phrase search</a> is simpler to use, but requires that the exact phrase specified appear in the results.

</p>

<ul><li><a href="Concept_Searching_Limited" title="Concept Searching Limited">Concept Searching Limited</a></li>

<li><a href="Enterprise_search" title="Enterprise search">Enterprise search</a></li>

<li><a href="Information_retrieval" title="Information retrieval">Information retrieval</a></li></ul>

<div class="mw-heading mw-heading2"><h2 id="References">References</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}

/* end https://en.wikipedia.org/ */

</style><div class="reflist reflist-columns references-column-width" style="column-width: 30em;">

/* start https://en.wikipedia.org/ */

.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("./mw/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("./mw/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("./mw/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("./mw/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}

/* end https://en.wikipedia.org/ */

</style><cite class="citation journal cs1 cs1-prop-long-vol"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20171115145846/https://www.conceptsearching.com/Web/UserFiles/File/Concept%20Searching%20Lateral%20Thinking.pdf">"Lateral Thinking in Information Retrieval"</a> <span class="cs1-format">(PDF)</span>. <i>Information Management and Technology</i>. 36 PART 4. Archived from <a rel="nofollow" class="external text" href="http://www.conceptsearching.com/Web/UserFiles/File/Concept%20Searching%20Lateral%20Thinking.pdf">the original</a> <span class="cs1-format">(PDF)</span> on 2017-11-15<span class="reference-accessdate">. Retrieved <span class="nowrap">2008-06-20</span></span>.</cite> The British Library Direct catalogue entry can be found here:<a rel="nofollow" class="external autonumber" href="http://direct.bl.uk/bld/PlaceOrder.do?UIN=138451913&ETOC=RN">[1]</a> <a rel="nofollow" class="external text" href="https://web.archive.org/web/20120210133832/http://direct.bl.uk/bld/PlaceOrder.do?UIN=138451913&ETOC=RN">Archived</a> 2012-02-10 at the <a href="Wayback_Machine" title="Wayback Machine">Wayback Machine</a></span>

</li>

<li id="cite_note-2"><span class="mw-cite-backlink"><b><a href="#cite_ref-2">^</a></b></span> <span class="reference-text"><a rel="nofollow" class="external autonumber" href="http://webarchive.nationalarchives.gov.uk/20040117000117/statistics.gov.uk/methods_quality/clamour/default.asp">[2]</a> National Statistics CLAMOUR project</span>

</li>

<li id="cite_note-3"><span class="mw-cite-backlink"><b><a href="#cite_ref-3">^</a></b></span> <span class="reference-text"><cite id="CITEREFRobertsonSpärck_Jones1976" class="citation journal cs1"><a href="Stephen_Robertson_(computer_scientist)" title="Stephen Robertson (computer scientist)">Robertson, S. E.</a>; <a href="Karen_Sp%C3%A4rck_Jones" title="Karen Spärck Jones">Spärck Jones, K.</a> (1976). "Relevance weighting of search terms". <i>Journal of the American Society for Information Science</i>. <b>27</b> (3): 129. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1002%2Fasi.4630270302">10.1002/asi.4630270302</a>.</cite></span>

</li>

<li id="cite_note-4"><span class="mw-cite-backlink"><b><a href="#cite_ref-4">^</a></b></span> <span class="reference-text"><cite id="CITEREFWILLIAMS1965" class="citation journal cs1">WILLIAMS, J.H. (1965). <a rel="nofollow" class="external text" href="https://web.archive.org/web/20110717145048/http://oai.dtic.mil/oai/oai?verb=getRecord">"Results of classifying documents with multiple discriminant functions"</a>. <i>Statistical Association Methods for Mechanized Documentation, National Bureau of Standards</i>. Washington: <span class="nowrap">217–</span>224. Archived from <a rel="nofollow" class="external text" href="http://oai.dtic.mil/oai/oai?verb=getRecord&metadataPrefix=html&identifier=AD0612272">the original</a> on 2011-07-17<span class="reference-accessdate">. Retrieved <span class="nowrap">2015-05-21</span></span>.</cite></span>

</li>

/* start https://en.wikipedia.org/ */

.mw-parser-output .citation{word-wrap:break-word}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}

/* end https://en.wikipedia.org/ */

</style><span class="citation patent"><a rel="nofollow" class="external text" href="https://worldwide.espacenet.com/textdoc?DB=EPODOC&IDX=US20060031195">US 20060031195</a></span><span class="Z3988" title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Apatent&rft.number=20060031195&rft.cc=US&rft.title="><span style="display: none;"> </span></span></span>

</li>

<li id="cite_note-6"><span class="mw-cite-backlink"><b><a href="#cite_ref-6">^</a></b></span> <span class="reference-text"><a rel="nofollow" class="external text" href="http://www.seobythesea.com/2012/02/google-acquires-cuil-patent-applications/">Google Acquires Cuil Patent Applications</a></span>

</li>

</ol></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .hlist dl,.mw-parser-output .hlist ol,.mw-parser-output .hlist ul{margin:0;padding:0}.mw-parser-output .hlist dd,.mw-parser-output .hlist dt,.mw-parser-output .hlist li{margin:0;display:inline}.mw-parser-output .hlist.inline,.mw-parser-output .hlist.inline dl,.mw-parser-output .hlist.inline ol,.mw-parser-output .hlist.inline ul,.mw-parser-output .hlist dl dl,.mw-parser-output .hlist dl ol,.mw-parser-output .hlist dl ul,.mw-parser-output .hlist ol dl,.mw-parser-output .hlist ol ol,.mw-parser-output .hlist ol ul,.mw-parser-output .hlist ul dl,.mw-parser-output .hlist ul ol,.mw-parser-output .hlist ul ul{display:inline}.mw-parser-output .hlist .mw-empty-li{display:none}.mw-parser-output .hlist dt::after{content:": "}.mw-parser-output .hlist dd::after,.mw-parser-output .hlist li::after{content:" · ";font-weight:bold}.mw-parser-output .hlist dd:last-child::after,.mw-parser-output .hlist dt:last-child::after,.mw-parser-output .hlist li:last-child::after{content:none}.mw-parser-output .hlist dd dd:first-child::before,.mw-parser-output .hlist dd dt:first-child::before,.mw-parser-output .hlist dd li:first-child::before,.mw-parser-output .hlist dt dd:first-child::before,.mw-parser-output .hlist dt dt:first-child::before,.mw-parser-output .hlist dt li:first-child::before,.mw-parser-output .hlist li dd:first-child::before,.mw-parser-output .hlist li dt:first-child::before,.mw-parser-output .hlist li li:first-child::before{content:" (";font-weight:normal}.mw-parser-output .hlist dd dd:last-child::after,.mw-parser-output .hlist dd dt:last-child::after,.mw-parser-output .hlist dd li:last-child::after,.mw-parser-output .hlist dt dd:last-child::after,.mw-parser-output .hlist dt dt:last-child::after,.mw-parser-output .hlist dt li:last-child::after,.mw-parser-output .hlist li dd:last-child::after,.mw-parser-output .hlist li dt:last-child::after,.mw-parser-output .hlist li li:last-child::after{content:")";font-weight:normal}.mw-parser-output .hlist ol{counter-reset:listitem}.mw-parser-output .hlist ol>li{counter-increment:listitem}.mw-parser-output .hlist ol>li::before{content:" "counter(listitem)"\a0 "}.mw-parser-output .hlist dd ol>li:first-child::before,.mw-parser-output .hlist dt ol>li:first-child::before,.mw-parser-output .hlist li ol>li:first-child::before{content:" ("counter(listitem)"\a0 "}

/* end https://en.wikipedia.org/ */

</style><style data-mw-deduplicate="TemplateStyles:r1236075235">

/* start https://en.wikipedia.org/ */

.mw-parser-output .navbox{box-sizing:border-box;border:1px solid #a2a9b1;width:100%;clear:both;font-size:88%;text-align:center;padding:1px;margin:1em auto 0}.mw-parser-output .navbox .navbox{margin-top:0}.mw-parser-output .navbox+.navbox,.mw-parser-output .navbox+.navbox-styles+.navbox{margin-top:-1px}.mw-parser-output .navbox-inner,.mw-parser-output .navbox-subgroup{width:100%}.mw-parser-output .navbox-group,.mw-parser-output .navbox-title,.mw-parser-output .navbox-abovebelow{padding:0.25em 1em;line-height:1.5em;text-align:center}.mw-parser-output .navbox-group{white-space:nowrap;text-align:right}.mw-parser-output .navbox,.mw-parser-output .navbox-subgroup{background-color:#fdfdfd}.mw-parser-output .navbox-list{line-height:1.5em;border-color:#fdfdfd}.mw-parser-output .navbox-list-with-group{text-align:left;border-left-width:2px;border-left-style:solid}.mw-parser-output tr+tr>.navbox-abovebelow,.mw-parser-output tr+tr>.navbox-group,.mw-parser-output tr+tr>.navbox-image,.mw-parser-output tr+tr>.navbox-list{border-top:2px solid #fdfdfd}.mw-parser-output .navbox-title{background-color:#ccf}.mw-parser-output .navbox-abovebelow,.mw-parser-output .navbox-group,.mw-parser-output .navbox-subgroup .navbox-title{background-color:#ddf}.mw-parser-output .navbox-subgroup .navbox-group,.mw-parser-output .navbox-subgroup .navbox-abovebelow{background-color:#e6e6ff}.mw-parser-output .navbox-even{background-color:#f7f7f7}.mw-parser-output .navbox-odd{background-color:transparent}.mw-parser-output .navbox .hlist td dl,.mw-parser-output .navbox .hlist td ol,.mw-parser-output .navbox .hlist td ul,.mw-parser-output .navbox td.hlist dl,.mw-parser-output .navbox td.hlist ol,.mw-parser-output .navbox td.hlist ul{padding:0.125em 0}.mw-parser-output .navbox .navbar{display:block;font-size:100%}.mw-parser-output .navbox-title .navbar{float:left;text-align:left;margin-right:0.5em}body.skin--responsive .mw-parser-output .navbox-image img{max-width:none!important}@media print{body.ns-0 .mw-parser-output .navbox{display:none!important}}

/* end https://en.wikipedia.org/ */

</style></div><div role="navigation" class="navbox" aria-labelledby="Natural_language_processing454" style="padding:3px"><table class="nowraplinks hlist mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><style data-mw-deduplicate="TemplateStyles:r1239400231">

/* start https://en.wikipedia.org/ */

.mw-parser-output .navbar{display:inline;font-size:88%;font-weight:normal}.mw-parser-output .navbar-collapse{float:left;text-align:left}.mw-parser-output .navbar-boxtext{word-spacing:0}.mw-parser-output .navbar ul{display:inline-block;white-space:nowrap;line-height:inherit}.mw-parser-output .navbar-brackets::before{margin-right:-0.125em;content:"[ "}.mw-parser-output .navbar-brackets::after{margin-left:-0.125em;content:" ]"}.mw-parser-output .navbar li{word-spacing:-0.125em}.mw-parser-output .navbar a>span,.mw-parser-output .navbar a>abbr{text-decoration:inherit}.mw-parser-output .navbar-mini abbr{font-variant:small-caps;border-bottom:none;text-decoration:none;cursor:inherit}.mw-parser-output .navbar-ct-full{font-size:114%;margin:0 7em}.mw-parser-output .navbar-ct-mini{font-size:114%;margin:0 4em}html.skin-theme-clientpref-night .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}@media(prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}}@media print{.mw-parser-output .navbar{display:none!important}}

/* end https://en.wikipedia.org/ */

</style><div id="Natural_language_processing454" style="font-size:114%;margin:0 4em"><a href="Natural_language_processing" title="Natural language processing">Natural language processing</a></div></th></tr><tr><th scope="row" class="navbox-group" style="width:1%">General terms</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="AI-complete" title="AI-complete">AI-complete</a></li>

<li><a href="Bag-of-words_model" title="Bag-of-words model">Bag-of-words</a></li>

<ul><li><a href="Bigram" title="Bigram">Bigram</a></li>

<li><a href="Trigram" title="Trigram">Trigram</a></li></ul></li>

<li><a href="Computational_linguistics" title="Computational linguistics">Computational linguistics</a></li>

<li><a href="Natural_language_understanding" title="Natural language understanding">Natural language understanding</a></li>

<li><a href="Stop_word" title="Stop word">Stop words</a></li>

<li><a href="Text_processing" title="Text processing">Text processing</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Text_mining" title="Text mining">Text analysis</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Argument_mining" title="Argument mining">Argument mining</a></li>

<li><a href="Collocation_extraction" title="Collocation extraction">Collocation extraction</a></li>

<li><a href="Concept_mining" title="Concept mining">Concept mining</a></li>

<li><a href="Coreference#Coreference_resolution" title="Coreference">Coreference resolution</a></li>

<li><a href="Deep_linguistic_processing" title="Deep linguistic processing">Deep linguistic processing</a></li>

<li><a href="Distant_reading" title="Distant reading">Distant reading</a></li>

<li><a href="Information_extraction" title="Information extraction">Information extraction</a></li>

<li><a href="Named-entity_recognition" title="Named-entity recognition">Named-entity recognition</a></li>

<li><a href="Ontology_learning" title="Ontology learning">Ontology learning</a></li>

<li><a href="Parsing" title="Parsing">Parsing</a>

<ul><li><a href="Semantic_parsing" title="Semantic parsing">Semantic parsing</a></li>

<li><a href="Syntactic_parsing_(computational_linguistics)" title="Syntactic parsing (computational linguistics)">Syntactic parsing</a></li></ul></li>

<li><a href="Part-of-speech_tagging" title="Part-of-speech tagging">Part-of-speech tagging</a></li>

<li><a href="Semantic_analysis_(machine_learning)" title="Semantic analysis (machine learning)">Semantic analysis</a></li>

<li><a href="Semantic_role_labeling" title="Semantic role labeling">Semantic role labeling</a></li>

<li><a href="Semantic_decomposition_(natural_language_processing)" title="Semantic decomposition (natural language processing)">Semantic decomposition</a></li>

<li><a href="Semantic_similarity" title="Semantic similarity">Semantic similarity</a></li>

<li><a href="Sentiment_analysis" title="Sentiment analysis">Sentiment analysis</a></li></ul>

<ul><li><a href="Terminology_extraction" title="Terminology extraction">Terminology extraction</a></li>

<li><a href="Text_mining" title="Text mining">Text mining</a></li>

<li><a href="Textual_entailment" title="Textual entailment">Textual entailment</a></li>

<li><a href="Truecasing" title="Truecasing">Truecasing</a></li>

<li><a href="Word-sense_disambiguation" title="Word-sense disambiguation">Word-sense disambiguation</a></li>

<li><a href="Word-sense_induction" title="Word-sense induction">Word-sense induction</a></li></ul>

</div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th id="Text_segmentation21" scope="row" class="navbox-group" style="width:1%"><a href="Text_segmentation" title="Text segmentation">Text segmentation</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul>

<li><a href="Lemmatisation" class="mw-redirect" title="Lemmatisation">Lemmatisation</a></li>

<li><a href="Lexical_analysis" title="Lexical analysis">Lexical analysis</a></li>

<li><a href="Shallow_parsing" title="Shallow parsing">Text chunking</a></li>

<li><a href="Stemming" title="Stemming">Stemming</a></li>

<li><a href="Sentence_boundary_disambiguation" title="Sentence boundary disambiguation">Sentence segmentation</a></li>

<li><a href="Word#Word_boundaries" title="Word">Word segmentation</a></li></ul>

</div></td></tr></tbody></table><div>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Automatic_summarization" title="Automatic summarization">Automatic summarization</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Multi-document_summarization" title="Multi-document summarization">Multi-document summarization</a></li>

<li><a href="Sentence_extraction" title="Sentence extraction">Sentence extraction</a></li>

<li><a href="Text_simplification" title="Text simplification">Text simplification</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Machine_translation" title="Machine translation">Machine translation</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Computer-assisted_translation" title="Computer-assisted translation">Computer-assisted</a></li>

<li><a href="Example-based_machine_translation" title="Example-based machine translation">Example-based</a></li>

<li><a href="Rule-based_machine_translation" title="Rule-based machine translation">Rule-based</a></li>

<li><a href="Statistical_machine_translation" title="Statistical machine translation">Statistical</a></li>

<li><a href="Transfer-based_machine_translation" title="Transfer-based machine translation">Transfer-based</a></li>

<li><a href="Neural_machine_translation" title="Neural machine translation">Neural</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Distributional_semantics" title="Distributional semantics">Distributional semantics</a> models</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<li><a href="Document-term_matrix" title="Document-term matrix">Document-term matrix</a></li>

<li><a href="Explicit_semantic_analysis" title="Explicit semantic analysis">Explicit semantic analysis</a></li>

<li><a href="FastText" title="FastText">fastText</a></li>

<li><a href="GloVe" title="GloVe">GloVe</a></li>

<li><a href="Language_model" title="Language model">Language model</a> (<a href="Large_language_model" title="Large language model">large</a>)</li>

<li><a href="Latent_semantic_analysis" title="Latent semantic analysis">Latent semantic analysis</a></li>

<li><a href="Word_embedding" title="Word embedding">Word embedding</a></li>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Language_resource" title="Language resource">Language resources</a>,<br>datasets and corpora</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%">Types and<br>standards</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Corpus_linguistics" title="Corpus linguistics">Corpus linguistics</a></li>

<li><a href="Lexical_resource" title="Lexical resource">Lexical resource</a></li>

<li><a href="Linguistic_Linked_Open_Data" title="Linguistic Linked Open Data">Linguistic Linked Open Data</a></li>

<li><a href="Machine-readable_dictionary" title="Machine-readable dictionary">Machine-readable dictionary</a></li>

<li><a href="Parallel_text" title="Parallel text">Parallel text</a></li>

<li><a href="PropBank" title="PropBank">PropBank</a></li>

<li><a href="Semantic_network" title="Semantic network">Semantic network</a></li>

<li><a href="Simple_Knowledge_Organization_System" title="Simple Knowledge Organization System">Simple Knowledge Organization System</a></li>

<li><a href="Speech_corpus" title="Speech corpus">Speech corpus</a></li>

<li><a href="Text_corpus" title="Text corpus">Text corpus</a></li>

<li><a href="Thesaurus_(information_retrieval)" title="Thesaurus (information retrieval)">Thesaurus (information retrieval)</a></li>

<li><a href="Treebank" title="Treebank">Treebank</a></li>

<li><a href="Universal_Dependencies" title="Universal Dependencies">Universal Dependencies</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Data</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="BabelNet" title="BabelNet">BabelNet</a></li>

<li><a href="Bank_of_English" title="Bank of English">Bank of English</a></li>

<li><a href="DBpedia" title="DBpedia">DBpedia</a></li>

<li><a href="FrameNet" title="FrameNet">FrameNet</a></li>

<li><a href="Google_Ngram_Viewer" class="mw-redirect" title="Google Ngram Viewer">Google Ngram Viewer</a></li>

<li><a href="WordNet" title="WordNet">WordNet</a></li>

<li><a href="Wikidata" title="Wikidata">Wikidata</a></li></ul>

</div></td></tr></tbody></table><div></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Automatic_identification_and_data_capture" title="Automatic identification and data capture">Automatic identification<br>and data capture</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Speech_recognition" title="Speech recognition">Speech recognition</a></li>

<li><a href="Speech_segmentation" title="Speech segmentation">Speech segmentation</a></li>

<li><a href="Speech_synthesis" title="Speech synthesis">Speech synthesis</a></li>

<li><a href="Natural_language_generation" title="Natural language generation">Natural language generation</a></li>

<li><a href="Optical_character_recognition" title="Optical character recognition">Optical character recognition</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Topic_model" title="Topic model">Topic model</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Document_classification" title="Document classification">Document classification</a></li>

<li><a href="Latent_Dirichlet_allocation" title="Latent Dirichlet allocation">Latent Dirichlet allocation</a></li>

<li><a href="Pachinko_allocation" title="Pachinko allocation">Pachinko allocation</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Computer-assisted_reviewing" title="Computer-assisted reviewing">Computer-assisted<br>reviewing</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Automated_essay_scoring" title="Automated essay scoring">Automated essay scoring</a></li>

<li><a href="Concordancer" title="Concordancer">Concordancer</a></li>

<li><a href="Grammar_checker" title="Grammar checker">Grammar checker</a></li>

<li><a href="Predictive_text" title="Predictive text">Predictive text</a></li>

<li><a href="Pronunciation_assessment" title="Pronunciation assessment">Pronunciation assessment</a></li>

<li><a href="Spell_checker" title="Spell checker">Spell checker</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Natural-language_user_interface" title="Natural-language user interface">Natural language<br>user interface</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Chatbot" title="Chatbot">Chatbot</a></li>

<li><a href="Interactive_fiction" title="Interactive fiction">Interactive fiction</a></li>

<li><a href="Question_answering" title="Question answering">Question answering</a></li>

<li><a href="Virtual_assistant" title="Virtual assistant">Virtual assistant</a></li>

<li><a href="Voice_user_interface" title="Voice user interface">Voice user interface</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Related</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Formal_semantics_(natural_language)" title="Formal semantics (natural language)">Formal semantics</a></li>

<li><a href="Hallucination_(artificial_intelligence)" title="Hallucination (artificial intelligence)">Hallucination</a></li>

<li><a href="Natural_Language_Toolkit" title="Natural Language Toolkit">Natural Language Toolkit</a></li>

<li><a href="SpaCy" title="SpaCy">spaCy</a></li></ul>

</div></td></tr></tbody></table></div></div><div><div class="zim-footer">

This article is issued from <a class="external text" title="Last edited on 2021-01-01" href="https://en.wikipedia.org/wiki/?title=Compound-term_processing&oldid=997530676">Wikipedia</a>. The text is available under <a class="external text" href="https://creativecommons.org/licenses/by-sa/4.0/deed.en">Creative Commons Attribution-Share Alike 4.0</a> unless otherwise noted. Additional terms may apply for the media files.

</div>

</div></div>

</div>

</main>

</div>

</body></html>